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ABSTRACT 



AN ENCODING METHOD AND APPARATUS FOR REPRESENTING A 

DIGITAL IMAGE 



The method encodes a digital image to provide a compressed representation of 
the image. The method initially performs a multi-level 2-D Discrete Wavelet Transform 
on the digital image, which is arranged in a hierarchical order of sub-bands. The method 
then tiles each sub-band to form a number of blocks of transform coefficients. The 
method then encodes each bitplane of each block from a maximum bitplane to a minimum 
bilplane in the following manner. The method divides a current bitplane into a number of 
first areas and/or a number of second areas, wherein each first area comprises a number of 
coefficients having corresponding most significant bits in the current bitplane or less and 
each second area comprises a number of coefficients having corresponding most 
significant bits in a bitplane greater than the current bitplane. The method then codes the 
significance of each first area in the current bitplane; and codes a corresponding bit of 
each coefficient in each second area of the current bitplane. 
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AN ENCODING METHOD AND APPARATUS FOR REPRESENTING A 

DIGITAL IMAGE 

Field of Invention 

5 The present invention relates in general to the coding of a block of coefficients 

and in particular to the coding of a block of transform coefficients of a digital image. 

Background of Invention 

The field of digital data compression and in particular digital image compression 
has attracted great interest for some time. 

10 In the field of digital image compression, many different techniques have been 

utilized. In particular, one popular technique is the JPEG standard, which utilizes the 
discrete cosine transform to transform standard size blocks of an image into 
corresponding cosine components. The JPEG standard also provides for the subsequent 
compression of the transformed coefficients. 

15 Recently, the field of wavelet transforms has gained great attention as an 

alternative form of data compression. The wavelet transform has been found to be highly 
suitable in representing data having discontinuities such as sharp edges. Such 
discontinuities are often present in image data or the like. 

Although the preferred embodiments of the present invention will be described 
20 with reference to the compression of image data, it will be readily evident that the 
preferred embodiment is not limited thereto. For examples of the many different 
applications of Wavelet analysis to signals, reference is made to a survey article entitled 
"Wavelet Analysis" by Bruce et. al. appearing in IEEE Spectrum, October 1996 pages 26 
- 35. For a discussion of the different applications of wavelets in computer graphics, 
25 reference is made to "Wavelets for Computer Graphics", I. Stollinitz et. al. published 
1996 by Morgan Kaufmann Publishers, Inc. 

It would be desirable to provide a method and hardware of an encoder so as to 
provide for efficient and effective encoding of a series of coefficients in order to 
substantially increase the speed of encoding. 



i 



CFP1487AU IPR27 477040 



.l:\ELEC\CISRA\IPR\IPR27\477040.doc 



'I 



* « 

• • • 

• • • • 



• • • • 

• • • 



- 2 - 

Summary of the Invention 

According to one aspect of the invention, there is provided a method of coding a 
block of coefficients, the method comprises the step of: (i) performing, for each bitplane 
of said block of transform coefficients from a maximum bitplane to a minimum bitplane, 

5 the sub-steps of: (i)(a) dividing a current bitplane of the block of transform coefficients 
into a number of first areas and/or a number of second areas, wherein each first area 
comprises a number of said coefficients having corresponding most significant bits in the 
current bitplane or less and each second area comprises a number of coefficients having 
corresponding most significant bits in a bitplane greater than the current bitplane; (i)(b) 

10 coding the significance of each said first area in said current bitplane of said block of 
transform coefficients; and (i)(c) coding a corresponding bit of each coefficient in each 
said second area of said current bitplane. 

According to another aspect of the invention, there is provided a method of 
coding a block of transform coefficients, the method comprising the step of: (i) 

15 performing, for each bitplane of said block of transform coefficients from a maximum 
bitplane to a minimum bitplane, the sub-steps of: (i)(a) coding the significance of each 
coefficient in any one or more sub-regions of said current bitplane, if said sub-region is 
of a predetermined minimum size and comprise coefficients having corresponding most 
significant bits in the current bitplane or less; (i)(b) coding the significance of a said sub- 

20 region of a current bitplane of said block of transform coefficients, if said sub-region 

comprises a number of said coefficients having corresponding most significiant bits in the 
current bitplane or less; (i)(c) partitioning one said sub-region into further sub-regions if 
said sub-region prior to partitioning is significant and is greater than said predetermined 
minimum size; (i)(d) repeating said steps (i)(b) and (i)(c) for each remaining said sub- 

25 region; and (i)(e) coding a corresponding bit of each coefficient in any one or more sub- 
regions of said current bitplane, if the sub-regions comprise coefficients having 
corresponding most significant bits in a bitplane greater than the current bitplane. 

According to still another aspect of the invention, there is provided apparatus 
for coding a block of coefficients, the apparatus comprising: means for performing, for 
30 each bitplane of said block of transform coefficients from a maximum bitplane to a 

minimum bitplane, the operations of the following division means, first coding means, 



CFP1487AU IPR27 477040 



.l:\ELEC\CISRA\IPR\IPR27\477040.doc 



- 3 - 

and second coding means; division means for dividing a current bitplane of the block of 
transform coefficients into a number of first areas and/or a number of second areas, 
wherein each first area comprises a number of said coefficients having corresponding 
most significant bits in the current bitplane or less and each second area comprises a 
5 number of coefficients having corresponding most significant bits in a bitplane greater 
than the current bitplane; first coding means for coding the significance of each said first 
area in said current bitplane of said block of transform coefficients; and second coding 
means for coding a corresponding bit of each coefficient in each said second area of said 
current bitplane. 

10 According to still another aspect of the invention, there is provided apparatus 

for coding a block of transform coefficients, the apparatus comprising: means for 
performing, for each bitplane of said block of transform coefficients from a maximum 
bitplane to a minimum bitplane, the operations of the following first coding means, 
second coding means, partitioning means, repetition means, and third coding means; first 

15 coding means for coding the significance of each coefficient in any one or more sub- 
regions of said current bitplane, if said sub-region is of a predetermined minimum size 
and comprise coefficients having corresponding most significant bits in the current 
bitplane or less; second coding means for coding the significance of a said sub-region of a 
current bitplane of said block of transform coefficients, if said sub-region comprises a 

20 number of said coefficients having corresponding most significiant bits in the current 
bitplane or less; partition means for partitioning one said sub-region into further sub- 
regions if said sub-region prior to partitioning is significant and is greater than said 
predetermined minimum size; repetition means for repeating the operations of the second 
coding means and partition means for each remaining said sub-region; and third coding 

25 means for coding a corresponding bit of each coefficient in any one or more sub-regions 
of said current bitplane, if the sub-regions comprise coefficients having corresponding 
most significant bits in a bitplane greater than the current bitplane. 

According to still another aspect of the invention, there is provided a computer 
program product comprising a computer readable medium having a computer program for 
30 coding a block of coefficients, the computer program product comprising: means for 
performing, for each bitplane of said block of transform coefficients from a maximum 
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bitplane to a minimum bitplane, the operations of the following arrangement means, first 
coding means, and second coding means; division means for dividing a current bitplane of 
the block of transform coefficients into a number of first areas and/or a number of second 
areas, wherein each first area comprises a number of said coefficients having 

5 corresponding most significant bits in the current bitplane or less and each second area 
comprises a number of coefficients having corresponding most significant bits in a 
bitplane greater than the current bitplane; first coding means for coding the significance of 
each said first area in said current bitplane of said block of transform coefficients; and 
second coding means for coding a corresponding bit of each coefficient in each said 

10 second area of said current bitplane. 

According to still another aspect of the invention, there is provided a computer 
program product comprising a computer readable medium having a computer program for 
coding a block of transform coefficients, the computer program product comprising: 
means for performing, for each bitplane of said block of transform coefficients from a 

15 maximum bitplane to a minimum bitplane, the operations of the following first coding 
means, second coding means, partitioning means, repetition means, and third coding 
means; first coding means for coding the significance of each coefficient in any one or 
more sub-regions of said current bitplane, if said sub-region is of a predetermined 
minimum size and comprise coefficients having corresponding most significant bits in the 

20 current bitplane or less; second coding means for coding the significance of a said sub- 
region of a current bitplane of said block of transform coefficients, if said sub-region 
comprises a number of said coefficients having corresponding most significiant bits in the 
current bitplane or less; partition means for partitioning one said sub-region into further 
sub-regions if said sub-region prior to partitioning is significant and is greater than said 

25 predetermined minimum size; repetition means for repeating the operations of the second 
coding means and partition means for each remaining said sub-region; and third coding 
means for coding a corresponding bit of each coefficient in any one or more sub-regions 
of said current bitplane, if the sub-regions comprise coefficients having corresponding 
most significant bits in a bitplane greater than the current bitplane. 

30 According to still another aspect of the invention, there is provided an encoder 

for generating a coded representation of a digital image, said encoder comprising: an 
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input means for inputting a block of coefficients of said digital image; a plurality of tree 
builders, wherein each tree builder generates a tree and nodes based on a corresponding 
bitplane of said block of coefficients, and each said node corresponds to one of a plurality 
of sub-regions of said block of coefficients or to one of said coefficients and each said 

5 node having a data value indicative of the significance of said one sub-region or said one 
coefficent for that bitplane; a bitplane converter for generating respective bitplanes from 
the block of coefficients; and a bitplane encoder coupled to said plurality of tree builders 
and said bitplane converter for producing a coded representation of the digital image from 
said trees and bitplanes, wherein said bitplane encoder codes the significance of said sub- 

10 regions or coefficients in a current said bitplane when said sub-regions and coefficients 
have corresponding most significant bits in the current bitplane or less and codes 
corresponding bits of coefficients in said current bitplane when said coefficients have 
corresponding most significant bits in a bitplane greater than the current bitplane. 

According to still another aspect of the invention, there is provided an encoder 
15 for generating a coded representation of a digital image, said encoder comprising: an 
input means for inputting a block of coefficients of said digital image; a tree builder for 
generating a tree and nodes based on said block, wherein each said node corresponds to 
one of a plurality of regions of said coefficients or to one of said coefficients and each 
said node having a bitplane number of the largest significiant bitplane of the region or 
20 coefficient corresponding to that node; a tree sorter for sorting said nodes in a 

predetermined order; a plurality of bitplane encoders coupled to said tree sorter, wherein 
said nth bitplane encoder outputs a coded representation of nth bitplane of the coefficients 
and wherein said nth bitplane encoder codes the significance of said sub-regions or 
coefficients of said nth bitplane when said sub-regions and coefficients have 
25 corresponding most significant bits in the nth bitplane or less and codes corresponding 
bits of coefficients in said nth bitplane when said coefficients have corresponding most 
significant bits in a bitplane greater than the nth bitplane; and a combiner for combining 
the coded representations of the n bitplanes to produce a coded representation of the 
digital image. 

30 
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Brief Description of the Drawings 

Embodiments of the invention are described with reference to the drawings, in 

which: 

Fig. 1A illustrates an original image; 

Fig. IB illustrates a DWT transformation of the original image of Fig. 1 A; 
Fig. 2 illustrates a second level DWT transformation of the original image shown 
in Fig. iA; 

Fig. 3 illustrates a four level DWT transformation of the original image shown in 

Fig. 1A; 

Fig. 4 illustrates the tiling of the subbands into 32x32 blocks; 
Fig 5 illustrates a general-purpose computer for implementing the preferred 
method in accordance with a first preferred embodiment; 

Fig. 6 illustrates an encoder in accordance with a second preferred embodiment; 
Fig. 7 illustrates a portion of a tree constructed by a bitplane tree builder of Fig. 

6; 

Fig. 8 illustrates an encoder in accordance with a third preferred embodiment; 

Detailed Description 

Where reference is made in any one or more of the accompanying drawings to 
steps and/or features, which have the same reference numerals, those steps and/or features 
have for the purposes of this description the same fxinction(s) or operation(s), unless the 
contrary intention appears. 
Preferred Erabodiment(s) of Method 

The principles of the preferred method have general applicability to the encoding 
and decoding of a block of coefficients. For ease of explanation, the preferred method is 
described with reference to the encoding and decoding of a block of transform 
coefficients of an image and it it is not intended to be limited thereto. The method has 
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also been described with reference to a number of specific examples of images and it is 
also not intended that the invention be limited to such specific examples. 

The preferred method proceeds initially by means of a wavelet transform of 
image data. An overview of the wavelet process will now be described with reference to 
5 the accompanying drawings. 

Referring initially to Figs. 1A and IB, an original image I is transformed 
utilizing a Discrete Wavelet Transform (DWT) into four sub-images 3-6. The sub-images 
or subbands are normally denoted LL1, HL1, LH1 and HH1. The one suffix on the 
subband names indicates level I. The LL1 subband is a low pass decimated version of 
10 the original image. 

The wavelet transform utilized can vary and can include, for example, Haar basis 
functions, Daubechies basis functions etc. The LL1 subband is then in turn utilized and a 
second Discrete Wavelet Transform is applied as shown in Figure 2 giving subbands LL2 
(8), HL2 (9), LH2 (10), HH2 (1 1). This process is continued for example as illustrated in 
15 Figure 3 wherein the LL4 subband is illustrated. Obviously, further levels of 

decomposition can be provided depending on the size of the input image. The lowest 
frequency subband is referred to as the DC subband. In the case of Figure 3, the DC 
subband is the LL4 subband. 

Each single level DWT can, in turn, be inverted to obtain the original image. 
20 Thus, a J-ievel DWT can be inverted as a series of J-single level inverse DWT's. 

To code an image hierarchically the DC subband is coded first. Then, the 
remaining subbands are coded in order of decreasing level. That is for a 4 level DWT, the 
subbands at level 4 are coded after the DC subband (LL4). That is the HL4, LH4 and 
HH4 subbands. The subbands at level 3 (HL3, LH3, and HH3) are then coded, followed 
25 by those at level 2 (HL2, LH2 and HH2) and then level 1 (HL1 , LH1 and HH1). 

With standard images, the encoded subbands normally contain the "detail" 
information in an image. After quantisation of the subbands, they often consist of a 
sparse array of values and substantial compression can be achieved by efficient encoding 
of their sparse matrix form. 
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Turning now to Fig. 4, there is shown the tiling of the subbands, such as HH1 . The 
subbands are preferably tiles 4 1 0, 420, 430, 440 and 450 with 32x32 blocks of 
coefficients beginning from the top left-hand corner. The nomenclature 32x32 refers to 32 
rows by 32 columns respectively. 

Before proceeding with a description of the embodiments, a brief review of 
terminology used hereinafter is provided. For a binary integer representation of a number, 
"bit n" or "bit number n" refers to the binary digit n places to the left of the least 
significant bit (beginning with bit 0). For example, assuming an 8-bit binary 
representation, the decimal number 9 is represented as 00001001. In this number, bit 3 is 
equal to 1, while bits 2, 1, and 0 are equal to 0, 0, and 1, respectively. In addition, a 
transform of an image may be represented as a matrix having coefficients arranged in 
rows and columns, with each coefficient represented by a bit sequence. Conceptually 
speaking the matrix may be regarded as having three dimensions; one dimension in the 
row direction; a second dimension in the column direction and a third dimension in the bit 
sequence direction. A plane in this three-dimensional space that passes through each bit 
sequence at the same bitnumber is referred to as a "bitplane" or "bit plane". The term "bit 
plane number n" refers to that bit plane that passes through bit number n. 

To simplify the description and not to obscure unnecessarily the invention, the 
transform coefficients are assumed hereinafter to be represented in a fixed point unsigned 
binary integer format, with an additional single sign bit. Preferably, 16 bits is used. That 
is, the decimal numbers -9 and 9 are represented with the same bit sequence, namely 
1001, with the former having a sign bit equal to 1 to indicate a negative value, and the 
latter having a sign bit equal to 0 to indicate a positive value. In using an integer 
representation, the coefficients are implicitly already quantized to the nearest integer 
value, although this is not necessary for embodiments of the invention. Further, for the 
purpose of compression, any information contained in fractional bits is normally ignored. 

A region of an image frame includes a set of contiguous image coefficients. The 
term coefficient is used hereinafter interchangeably with pixel, however, as will be well 
understood by a person skilled in the art, the former is typically used to refer to pixels in a 
transform domain (eg., a DWT domain). These sets or regions T are defined as having 
transform image coefficients {c fJ } , where (ij) is a coefficient coordinate. 
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. A set or the region T of pixels at a current bit plane is said to be insignificant if 
the msb number of each coefficient in the region is less than the value of the current bit 
plane. To make the concept of region significance precise, a mathematical definition is 
given in Equation (1). A set or region T of pixels is said to be insignificant with respect 
to (or at) bit plane n if, 

|c,, J < 2'', for all e- fJ eT 0) 

By a partition of a set T of coordinates we mean a collection {r„, } of subsets of T such 

that 

T= vT m , T„nT m =Wn*m 



In other words if c,. ,. e T then c gJ e T m for one, and only one, of the subsets T m . In our 
case T is a square region and the set {T„, } is the set consisting of the four quadrants of T. 

The preferred method encodes a set of coefficients in an embedded manner using 
quadtrees. The use of the term embedded is taken to mean that every bit in a higher bit 
15 plane is coded before any bit in a lower bit plane. For example, every bit is coded in bit 
plane 7 before any bit in bit plane 6. In turn, all bits in bit plane 6 are coded before any bit 
plane 5 and so on. 

A preferred embodiment of the preferred method is implemented utilizing the 
following pseudo-code. The preferred method preferably encodes a square block of 

20 coefficients, with a block size that is a power of 2 (typically 32x32 coefficients). Further, 
the preferred method utilizes a quadtree partition: that is each set or region is partitioned 
into its 4 quadrants: thus maintaining at all times square regions with a dimension equal 
to a power of two. The preferred method, during commencement, initializes three lists: a 
list of insignificant regions (LIR); a list of insignificant coefficients (LIC); and a list of 

25 significant coefficients (LSC). When single coefficients are removed from the list of 

insignificant sets (LIR), they are added to either the list of insignificant coefficients (LIC) 
or to the list of significant coefficients (LSC), depending on the significance of the 
coefficient. 
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The preferred method is initialized as follows. The LIC and LSC are initialized 
to be empty. The LIR is set to contain the four quadrants of the input block. The method 
commences by finding and coding w maxi which is the largest bit plane that contains a 1 bit 
in any one of the coefficients in the bitplane. Or in other words, the most significant bit of 
5 each coefficient is in bitplane w max or less. The encoded n max can be included in a header 
or sub-header of the bitstream for transmission. The preferred method then proceeds as 
follows: 



1 . Set n = rtmax 

10 2. For each coefficient in the list of insignificant coefficients (LIC) 

• Code bit n of the coefficient (i.e. its significance) 

• If the bit is 1 (i.e. it is significant) code a sign bit. Add the coefficient to the end of 
the LSC and remove the coefficient from the LIC. 

3. For each region T in the list of insignificant regions (LIR) 
15 ♦ Code the significance of T. 

• If T is significant and consists of more than one coefficient then partition T into its 
four quadrants and add these to the end of the LIR. Remove T from the list. 

• If T is a single coefficient 
•Remove T from the LIR 

20 • If T is significant code a sign bit and add T to the end of the LSC 

• Else add T to the end of the list of LIC 

4. For each coefficient c u in the list of significant coefficients LSC (excluding those 
added to the list in step 3) 

• Code bit n of c j Jt 

25 5. decrement n and go to step 2. 
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From the above, it can seen that output bitstream generally takes the following 

form 

...LICLIR'LSC 



where LIR' is the coded representation undertaken in step 3; LIC is the coded 
5 representation undertaken in step 2; and LSC is the coded representation undertaken in 
step 4. However, it should be noted that during the first iteration of the encoding process 
both LIC and LSC are empty and thus the output bitstream for the first iteration takes the 
form LIR'. 

In addition to the preferred method, a simple Huffman code (or better a Golomb 
10 code) may be used to code groups of bits (for example groups of 4 bits) when coding the 
LIC and LSC. Further, when coding the significance of each quadrant of a region a 15- 
level Huffman code may be used to indicate the significance pattern of each of the 4 
quadrants (one quadrant must be significant, hence the significance pattern can be one of 
15 (and not 1 6) different patterns. Other forms of entropy encoding can be used, such as 
15 binary arithmetic coding to exploit any remaining redundancy. 

As an alternative embodiment, the preferred method at step 3 if T consists of a 
2x2 block of coefficients, may perform the following substep. Immediately code and 
output the significance of each coefficient of the 2x2 block, output the corresponding sign 
bit(s) if they are significant; and then add the coefficients to the end of the LSC or the LIC 
20 as appropriate. In the latter substep, the significant coefficients are added to the LSC list 
whereas the insignificant coefficients are added to the LIC list. 

Preferably, the preferred method encodes a 32x32 block of data coefficients. For 
illustrative purposes only, the following example of a 4x4 block of coefficients is 
encoded in accordance with the preferred method. 

25 



31 


16 


0 


0 


1.5 


17 


0 


0 


9 


7 


1 


0 


5 


3 


1 


0 
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The above block consists of four quadrants A,B,C and D. The symbol A 
designates the top-left (2x2) quadrant of the block, B the top right, C the bottom left, and 
D the bottom right quadrant respectively. Furthermore, the symbols Al denote the top left 
pixel of A, A2 the top right, A3 the bottom left, A4 the bottom right pixels respectively. 
Similarly Bl denotes the top left pixel of B and so on for the rest of the pixels. 

According to the preferred method, w max is first determined, which in this case is 
4. That is, the most significant bit of each coefficient is in bit plane 4 or less. Note, the 
numbering of the bit planes commences from 0. The variable w max is coded with 4 bits 
(since the coefficients have been constrained, so that * max is between 0 and 15.). Initially 

LIC = <(», LIR = {A, B, C, D} and LSC = <t> 

where symbol $ is used to denote the empty list. 

Then, according to the preferred method, the bit planes are iteratively coded. The 
process commences at bit plane n - n mzx = 4, and decrements n by one at each iteration. 

l.Atn = n max = 4 

• First, each coefficient in the list LIC is coded. Since there are none, no coding is 
undertaken. 

♦ Then, the significance of each region in the list LIR is coded. 

• For region A, a 1 bit is outputted, since it is significant at bit plane n = 4. Then, 
the four quadrants of A are added, namely Al, A2, A3 and A4, to the end of the 
list LIR, and A is removed. Hence now LIR = {B, C, D, Al, A2, A3, A4}. 

• For region B, a 0 bit is output, since it is insignificant at bit plane n = 4. 

• For region C, a 0 bit is output. 

• For region D, a 0 bit is output. 

• For region Al, a 1 bit is output. Since Al consists of the single coefficient 31, Al 
is removed from the LIR. Since 31 (or Al) is significant, it is added (or its 
location in the block) to the LSC. The sign bit (0) of Al is also outputted. 
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• For region A2, a 1 bit is output. Since A2 consists of the single significant 
coefficient 16, it is removed from the LIR, and added to the end of the LSC. The 
sign bit (0) of A2 is also outputted. Now we have LSC = {31, 16}. 

• For region A3, a 0 bit is output. Since it is a single insignificant coefficient we 
remove it from the LIR, add the coefficient 15 to the LIC. Now LIC = {1 5}. 

• For region A4 a 1 bit is output. Since A4 consists of the single significant 
coefficient 17, it is removed from the LIR, and added to the end of the LSC. The 
sign bit (0) of A4 is also outputted. Now LSC - {31, 16, 17}. 

• Each coefficient in the LSC that was not added in the last step is now coded. Since 
there are none, no coding is undertaken. 

Thus at the first iteration, the preferred method outputs the following bitstream 

1000 10 10 0 10 

At this stage, all the bits in bit plane 4 (and higher) have been coded. That is a 
decoder can reconstruct bit plane 4 (and higher) by reading in the bits from the coded bit 
stream. The decoding method is the same except that the significance decisions are 
determined by reading from the bit stream (this is why the significance decision is written 
to the bit stream). The other coefficient bits are simply read in as is. Note that the decoder 
execution path is identical to the encoder, so that the decoder knows the meaning of each 
new bit that it reads. 
2.Atn = 3 

Initially LIC= {15}, LIR = {B,C,D} and LSC = {31, 16, 17}. 

• Firstly, bit n=0 of each coefficient in the LIC is coded. That is, a 1 bit is output for 
the coefficient 15 and a sign bit (0). Since it is significant (a 1 bit has been outputted), 
a sign bit is outputted, the coefficient 15 is removed from LIC and added to the end of 
the LSC. So now LSC = {31, 16, 17, 15}. 

• The significance of each of the regions in LIR are now coded 
• For region B, a 0 bit is output. 
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• For region C, a 1 bit is output, since it is significant at bitplane n=3. The region C 
is partitioned into four quadrants C1,C2,C3 andC4 which are added to the end of 
LIR. C is then removed from LIR. Hence now LIR = {B,D, C1,C2,C3, C4}. 

• For region D, a 0 bit is output. 

• For region CI, a 1 bit is output. Since CI consists of the single significant 
coefficient 9, it is removed from the LIR, and added to the end of the LSC. The 
sign bit (0) of CI is also outputted. Now we have LSC = {31, 16,17,15,9}. 

• For region C2, a 0 bit is output. Since it is a single insignificant coefficient we 
remove it from the LIR, add the coefficient 7 to the LIC. Now LIC = {7}. 

• For region C3, a 0 bit is output. Since it is a single insignificant coefficient we 
remove it from the LIR, add the coefficient 5 to the LIC. Now LIC = {7,5}. 

• For region C4, a 0 bit is output. Since it is a single insignificant coefficient we 
remove it from the LIR, add the coefficient 3 to the LIC. Now LIC = {7,5,3 } . 

• Now we code bit «=3 of each coefficient on the LSC (that was not just added above) 

• We output 1 , 0, and 0 as bit n=3 of 3 1 , 1 6 and 1 7 respectively 

Thus at the second iteration, the preferred method outputs the following bitstream 

100 1 0 100001 00 

3.^rn = 2 

Initially we have LIC = {7, 5, 3}, LIR = {C, D} and LSC = {31, 16, 17, 15, 9}. 

• Firstly, bit n=2 (or equivalently the significance at bit plane «=2) of each coefficient 
in the LIC is coded. That is, we output a 1 , 1 , and 0 for 7, 5, and 3 respectively. In 
addition, a sign bit for 7 (0) and 5 (0) is outputted and these coefficients are moved to 
the LSC. We leave 3 in the LIC. 

• Then the significance of each region in the LIR is coded 

• For region B, a 0 bit is output and for region D a 0 bit is output. 

• Finally we update bit n=2 for each of the coefficients in the LSC (not added above). 

• We output a 1 , 0, 0, 1 , and 0 for 3 1 , 1 6, 1 7, 1 5 and 9 respectively. 
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Thus at the third iteration, the preferred method outputs the following bitstream 

10 10000 1 00 1 0 

We continue in this fashion until bit plane 0, or some other terminating point. Note that 
we can terminate after any one of the (three) sub-passes, if we use a special termination 
code. (Basically FF is reserved as a termination code, and we force the coded bit stream 
never to contain an FF, unless we deliberately insert a termination code. 

As mentioned previously, the method is preferably utilized in encoding 32x32 
blocks of coefficients. In these circumstances, the original quadrants A,B,C,D each 
consist of 16x16 coefficients and the regions A 1 ,A2,...D4 each consist of 8x8 coefficients. 
It will be thus evident in encoding a 32x32 block, the block is partitioned in accordance 
with quadtree method five times, whereas in the example given the 4x4 block is 
partitioned only twice. 

The decoding process simply mimics the encoding process to reconstruct the 
pixels from the coded representation. The decoding process builds the LIC, LIR, and 
LSC lists for each bitplane from the bitstream and from a knowledge of the partitioning 
process. From these lists the decoding process then generates the bit values for the 
bitplane. 

For illustrative purposes only, the following example explains the decoding of 
the bitstream of the previous example. Firstly, the decoding method receives and decodes 
>W The method sets all bit values in the bitplanes greater than /w to zero. The method 
then decodes the bit values for the bitplane >w Initially, the decoding method decodes 
the following portion of the bitstream 

1000 10 10 010 

Initially, the LIC, LIR and LSC lists are set as follows: LIC = <(>, LIR = {A, B t C, 
D} and LSC = The process then decodes the bitstream with reference to the LIC list. 
Since the LIC is empty no decoding is undertaken. Next, the process decodes the 
bitstream with reference to the LIR list. Thus region A will allocated a 1 bit ( the first bit 
in the bitstream 1000 10 10 0 1 0). The decoding method has an inherent knowledge of the 
partitioning process, and in response to this 1 bit updates the LIR list as follows {B, C, D, 
Al , A2, A3, A4}. The decoding process continues with the bits in the bitstream allocating 



CFP1487AU IPR27 477040 



.l:\EtEC\CISRA\IPR\IPR27\477040.doc 



- 16- 

region B the 0 bit, region C the next 0 bit, region D the next 0 bit, coefficient Al the bits 
10, coefficient A2 the next bits 10, coefficient A3 the bit 0, and coefficient A4 the bits 10. 
From these values the bitplane at n mw can be generated. During this stage, LIC and LSC 
lists are also updated resulting in LSC = {A1.A2.A4} and LIR ={A3}. These updated lists 
will be used in the decoding of the subsequent bits of the bitstream in generating the bit 
values of the next bitplane n m3X . { . As can be seen, the decoding process mimics the 
encoding process in order to reconstruct the pixels. 
First Preferred Embodiment of Encoding Apparatus 

The encoding processes of the preferred method can be practiced using a 
conventional general-purpose computer, such as the one shown in Fig. 5, wherein the 
processes may be implemented as software executing on the computer. In particular, the 
steps of the coding methods are effected by instructions in the software that are carried 
out by the computer. The software may be divided into two separate parts; one part for 
carrying out the encoding methods; and another part to manage the user interface between 
i the latter and the user. The software may be stored in a computer readable medium, 
including the storage devices described below, for example. The software is loaded into 
the computer from the computer readable medium, and then executed by the computer. A 
computer readable medium having such software or computer program recorded on it is a 
computer program product. The use of the computer program product in the computer 
20 preferably effects an advantageous apparatus for encoding digital images in accordance 
with the embodiments of the invention. 

The computer system 500 consists of the computer 502, a video display 516, and 
input devices 518, 520. In addition, the computer system 500 can have any of a number 
of other output devices including line printers, laser printers, plotters, and other 
25 reproduction devices connected to the computer 502. The computer system 500 can be 
connected to one or more other computers via a communication interface using an 
appropriate communication channel such as a modem communications path, a computer 
network, or the like. The computer network may include a local area network (LAN), a 
wide area network (WAN), an Intranet, and/or the Internet 
30 The computer 502 itself consists of a central processing unit(s) (simply referred 

to as a processor hereinafter) 504, a memory 506 which may include random access 
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memory (RAM) and read-only memory (ROM), input/output (10) interfaces 508, a video 
interface 510, and one or more storage devices generally represented by a block 5 12 in 
Fig. 5. The storage device(s) 5 12 can consist of one or more of the following: a floppy 
disc, a hard disc drive, a magneto-optical disc drive, CD-ROM, magnetic tape or any 
5 other of a number of non-volatile storage devices well known to those skilled in the art. 
Each of the components 504 to 5 12 is typically connected to one or more of the other 
devices via a bus 514 that in turn can consist of data, address, and control buses. 

The video interface 510 is connected to the video display 516 and provides video 
signals from the computer 502 for display on the video display 516. User input to operate 

10 the computer 502 can be provided by one or more input devices 508. For example, an 
operator can use the keyboard 5 1 8 and/or a pointing device such as the mouse 520 to 
provide input to the computer 502. 

The system 500 is simply provided for illustrative purposes and other 
configurations can be employed without departing from the scope and spirit of the 

15 invention. Exemplary computers on which the embodiment can be practiced include 

IBM-PC/ATs or compatibles, one of the Macintosh (TM) family of PCs, Sun Sparcstation 
(TM), or the like. The foregoing are merely exemplary of the types of computers with 
which the embodiments of the invention may be practiced. Typically, the processes of the 
embodiments, described hereinafter, are resident as software or a program recorded on a 

20 hard disk drive (generally depicted as block 512 in Fig. 5) as the computer readable 
medium, and read and controlled using the processor 504. Intermediate storage of the 
program and pixel data and any data fetched from the network may be accomplished 
using the semiconductor memory 506, possibly in concert with the hard disk drive 512. 

In some instances, the program may be supplied to the user encoded on a 
25 CD-ROM or a floppy disk (both generally depicted by block 512), or alternatively could 
be read by the user from the network via a modem device connected to the computer, for 
example. Still further, the software can also be loaded into the computer system 500 from 
other computer readable medium including magnetic tape, a ROM or integrated circuit, a 
magneto-optical disk, a radio or infra-red transmission channel between the computer and 
30 another device, a computer readable card such as a PCMCIA card, and the Internet and 
Intranets including email transmissions and information recorded on websites and the 
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like. The foregoing are merely exemplary of relevant computer readable mediums. Other 
computer readable mediums may be practiced without departing from the scope and spirit 
of the invention. 

Second Preferred Embodiment of Encoding Apparatus. 

5 T h e encoding method may alternatively be implemented in dedicated 

hardware such as one or more integrated circuits performing the functions or sub 
functions of the encoding processes. 

Turning to Fig. 6, there is shown an encoder in accordance with a seond 
preferred embodiment for implementing the preferred encoding method. The coefficient 
10 encoder 600 is designed to provide a continual flow of output encoded data 602 taking in 
corresponding data 604. The encoder 600 includes the following logic portions; a bit 
plane converter 606; bit plane tree builders 608-O to 608-15; and a bit plane encoder 610. 

The encoder 600 also includes a memory 614 for storing the 32x32 coefficients 
in bit planes; a memory 616 for storing the sign bits of the coefficients; and memories 
15 618-15 to 618-0 for storing bit plane trees 0 to 15. The encoder 600 further includes a 
memory 626 for storing a first list of regions; a FIFO memory 628 for storing a second 
list of regions; a memory 622 for storing a list of LSC values; and a memory 624 for 
storing a list of LIC values. 

The encoder 600 operates in the following manner. Initially, the 32x32 input 
20 coefficient data are stored in the memory 612 in raster order. The bit plane converter 606 
reads the input coefficient data and converts the data into 16 bit planes from bitplane 0 
through to bitplane 15, which are subsequently stored in memory 614. The bit plane 
converter 606 also determines the sign bit of the coefficients of the 32x32 block, which 
sign bits are stored in memory 616. 
25 The bit plane tree builders 608-0 to 608-15 each read the 32x32 coefficient data 

and construct a quadtree structure having nodes corresponding to regions and lxl pixels. 
In each tree, the nodes are set to 1 if the region or pixel corresponding to that node is 
significant for that bitplane. If the significant bit for the region or pixel corresponding to 
that node is greater than or less than the bitplane then the node is set to zero. 
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Turning now to Fig. 7, there is shown a constructed tree 700 built by a bitplane 
treebuilder 608-n at a bitplane n for a 32x32 block. For simplicities sake only a portion of 
the tree is shown. The tree 700 includes nodes representing each quadtree partition of the 
block down to the Ixl-pixel level. In this tree, the whole 32x32 block is represented by 
the symbol O. The 16x16 top left quadrant is represented by node A, the 16x16 top right 
quadrant is represented by B, the 16x16 bottom left quadrant is represented by node C, 
the 16x16 bottom right quadrant is represented by node D. The nodes Al,A2,A3,and A4 
represent the top left, top right, bottom left, and bottom right 8x8 quadtree partitions of 
the quadrant A respectively. Similarly, the nodes Al 1, A12,A13,and AH represent the 
top left, top right, bottom left, and bottom right 4x4 quadtree partitions of the quadrant Al 
respectively. Similarly the nodes Al 1 1, Al 12,A1 13,and Al 14 represent the top left, top 
right, bottom left, and bottom right 2x2 quadtree partitions of the quadrant All 
respectively. Finally, the nodes Al 1 1 1 , Al 1 12, Al 1 1 3, and Al 1 14 represent the top left, 
top right, bottom left, and bottom right 1x1 quadtree partitions (i.e. pixels) of the quadrant 
Al 1 1 respectively. The remaining parts of the tree (not shown) is represented in a similar 
manner down to each Ixl quadrant of the 32x32 block. 

The bit plane treebuilder 608-n builds such a tree from bottom up for bitplane n 
by reading the coefficients in quadrant order (e.g. Al 1 1 1,A1 1 12,A1 1 13, and Al 1 14). The 
tree builder sets the nodes of the tree to 1 if the region or pixel corresponding to that node 
is significant for that bitplane. If the significant bit for the region or pixel corresponding 
to that node is greater than or less than the bitplane then the node is set to zero by the tree 
builder. The bit plane tree builder then outputs the significance information for each node 
in the following format. 

A B C D Al A2 A3 A4 Al 1 A12 A13 A14 A21.....D44 Al 1 1,...,D444 Al 1 1 1 ,...,D4444 

The output from each of the bitplane tree builders 608-0 to 608-15 are then 
stored in respective bitplane tree memories 618-0 to 618-15. 

The bit plane encoder 610 reads each of the bit plane tree memories in turn, 
commencing with bit plane tree memory 618-15. The bit plane encoder 610 starts 
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processing by reading in turn the four significance bits A,B|C, and D stored in the bit 
plane memory 618-15 corresponding to the nodes A, B, C, and D. The bit plane encoder 
stores a list of these nodes {A,B,C,D} in a first list of regions in memory 626. The bit 
plane encoder 610 then proceeds with the following operations: 

1 . The bit plane encoder 610 reads the bit in the bit plane tree corresponding to the first 
node (region) on the first region list. 

a. If the bit is significant, the encoder outputs a binary one. The encoder then 
stores the children of the node in the second region list on the FIFO 628 and 
removes the node from the first region list 626. 

b. If the bit is insignificant, the encoder outputs a binary zero and retains the node 
on the first region list 626. 

2. The bit plane encoder 610 repeats step 1 until all nodes in the first region list have been 
read. 

3. The bit plane encoder reads the bit in the bit plane tree corresponding to the first node in 
the second region list on the FIFO 628. 

a. If the bit is insignificant and there are children to that node (viz. there are 
nodes directly below that node in the tree), the encoder outputs a binary zero 
and puts that node on first region list 626. 

b. If the bit is insignificant and there are no children to that node, the encoder 
outputs a binary zero and that node is stored on the LIC list 624 as an index to 
the corresponding pixel. 

c. If the bit is significant and has no children to that node, the encoder outputs a 
binary one and the corresponding sign bit and stores that node on the LSC list 
622 as an index to the corresponding pixel. 

d. If the bit is significant and has children to that node, the encoder outputs a 
binary one and removes the node from the second region list. In addition, it 
adds the children of that node to the second region list. 

e. If the second region list is empty, the encoding process is completed for that 
bit plane tree. 
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The bit plane encoder repeats this operation for the remaining bit plane trees in 
turn. The first list of regions at the start of the operation on the current bitplane tree 
contains those regions remaining from the previous operation on the previous bitplane 
tree. These outputs bits correspond to the LIR' portion of the output stream. After 
5 completion of a current operation for a current bitplane tree, the bitplane encoder then 
encodes and outputs the LIC and LSC bits. 

The bit plane encoder encodes the LIC bits by reading the LIC list for the index 
to the first pixel on the list, and using the current bit plane number selects the bit needed , 
from the bit plane memory 614. If the selected bit is a binary zero, then the encoder 
10 outputs a zero. If the selected bit is a binary one, then the encoder outputs a binary one 
together with the sign bit of the pixel from memory 616. The encoder then removes the 
index from the LIC list and adds it to the LSC list. Preferably, once an index is removed 
from the list, the remaining indices are reorganized. The encoding is completed once the 
LIC list is traversed. 

15 The bit plane encoder 600 encodes the LSC bits by reading the LSC list for the 

index to the first pixel on the list, and using the current bit plane number to select the bit 
needed from the bit plane memory 614. The selected bit is then outputted. The bit plane 
encoder also includes a counter for storing a length value, which is indicative of the 
number of pixels in the LSC list to be read. At the end of the LSC encoding the value is 

20 updated so that the new elements from LIR and LIC can be added. 

Third Preferred Embodiment of Encoding Apparatus. 

Turning to Fig. 8, there is shown an encoder in accordance with a third preferred 
embodiment for implementing the preferred encoding method. The coefficient encoder 
800 is designed to provide a continual flow of output encoded data 804 taking in 
25 corresponding data 802. 

The encoder 800 includes the following main logic portions; a tree builder 806, a 
tree node sorter 808, a LIC-LIR reader 812, a LSC reader 814, bit plane encoders 810-0 to 
810-15 in parallel, bit plane code combiners 816-0 to 816-15 in parallel, and a block code 
combiner 818. 
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The encoder 800 also includes the following main storage portions; a memory 
824 for storing a maximum bit plane tree; a memory 820 for storing a list of insignificant 
coefficients (LIC) and a list of insignificant regions (LIR); a memory 822 for storing a list 
of significant coefficients (LSC); LIR storage elements 826-0 to 826-15; LIC storage 
5 elements 828-0 to 828-15; LSC storage elements 830-0 to 830-15; and bit plane code 
buffers 832-0 to 832-15. 

The encoder 800 operates in the following manner. A 32x32 block of coefficients 
are stored in a buffer 803 and fed in raster order to both the tree builder 806 and the tree 
node sorter 808. The tree builder 806 builds, for each 32x32 block, a tree wherein the 
10 nodes of tree correspond to the quadrants of the block. That is, the top node of the tree 
corresponds to the whole block, the four child nodes of the top node correspond to the 
quadrants A,B,C, and D and so on. The tree continues downwards until the 1x1 regions 
(i.e. pixels) are reached. The tree builder 806 allocates, for each node in the tree, the bit 
plane number of the maximum significant bit plane of the region corresponding to that 
1 5 node. For instance, in the example given above, region 'A 1 consists of coefficients 31,16, 
15, and 17. In this case, node 'A* of the tree will be allocated with the bit plane number 4. 
In addition, nodes 7U', 'A2\ *A3\ and 'A4' of the tree will be allocated with the bit plane 
numbers 4, 4, 3, and 4 respectively. The tree builder 806 outputs and stores this tree to a 
buffer 824. 

20 The tree node sorter 808 sorts the regions (including 1x1 regions) of the block in 

a predetermined manner and feeds these either to the LIC/LIR list 820 or the LSC list 
822. 

The tree node sorter 808 has an internal list, which is made up of sublists, one for 
each bit plane number. The tree node sorter 808 sorts the regions of the block in the 
25 following manner: 

1 . The tree node sorter 808 reads the bit plane number of the top four nodes of the tree 
from the buffer 824, and inserts these nodes into the sublists, according to the bit plane 
number of the node. If two nodes have the same bit plane number, then the node on the 
left side of the tree appears first on the sublist. 
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2. At the same time, the tree node sorter 808 writes the four nodes into the LIC/LIR list 
820, with the nodes in order from left to right [ i.e. the far left one first, the far right one 
last]. The LIC/LIR list 820 is made up of an array of said regions. 

3. The tree node sorter 808 then gets the region at the head of the first non-empty sublist, 
and get its four child nodes. If these child nodes are regions, the tree node sorter 808 then 
inserts them into the sublists, according to their respective bit plane number. If these child 
nodes are coefficients, they are not inserted in the sublists. 

4. At the same time, the tree node sorter 808 writes the four child nodes into the LIC/LIR . 
list 820, with the nodes in order from left to right[ i.e. the far left one first, the far right 
one last]. 

5. Also, if the child nodes are coefficients, the tree node sorter 808 inserts them into the 
LSC coefficient list 822. The LSC coefficient list 822 is made up of sublists, one for each 
bit plane number. The new coefficients are added at the end of the LSC sublist according 
to their bit plane number. 

6. The tree node sorter 808 repeats step 3 until the internal list is empty. 

The LIC/LIR reader 812 accesses and reads each region or coefficients of the 
LIC/LIR list 820 in order and the corresponding node stored in the buffer 824. The reader 
812 generates and outputs , for each read region, the bit plane number of the maximum 
significant bit plane for the read region (hereinafter called maxjrit). The reader 812 also 
outputs, for each read region, the bit plane number of the maximum significant bit plane 
of the region consisting of the read region and its sibling quadrants( hereinafter called 
max_max_bit). The reader 812 also outputs , for each read region, a flag indicating 
whether the read region is pixel or a region. This data is outputted in the order of the 
LIC/LIR array 820 and sent to each of the bit plane encoders 810-0 to 810-15. 

The LSC reader 814 accesses and reads the LSC coefficient list 822 in order and 
the corresponding node stored in the buffer 824. The reader 814 generates and outputs, for 
each read coefficient, the max_bit number, the maxjnaxjrit number and the actual pixel 
value. The data is output to the bit plane encoders 810-0 to 810-15 from the most 
significant sublist [left to right] to the least significant sublist. The bit zero of the pixel 
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goes to bit plane encoder 810-0, bit one of the pixel goes to bit plane encoder 810-1, and 
so on through to bit fifteen of the pixel which goes to bit plane encoder 810-15. 

The bitplane encoders 810-0 to 810-15 are each assigned a constant herein called 
bit_plane_processing, wherein the bitplane encoder 810-0 is assigned a 
bit_plane_processing constant of zero, the encoder 810-1 a constant of one, and so on 
through to bit plane encoder 810-15 which is assigned a bit_plane_processing constant of 
fifteen. The bitplane encoders 8 1 0-0 to 81 0-1 5 each have a LSC filter and parallel LIC 
and LIR filters (not shown). The output data from the LSC reader 814 is fed to the LSC 
filters and the output data from the LIC/LIR reader 812 is fed to both the LIC and LIR 
filters. The LIR, LIC and LSC filters of the bit plane encoders 810-0 to 810-15 perform 
the following operations: 

1 . Filtering Rules for LIC filter 
IF flag is set to pixel 

IF max_max_bit > bit_plane_processing THEN 

IF max_bit > bit_plane_processing THEN 
Ignore 

ELSE IF max_bit « bit_planejprocessing THEN 

Output One and sign bit 
ELSE 

Output Zero 
ENDIF 

ENDIF 

ENDIF 

2. Filtering Rules for LSC filter 

IF max_max_bit > bit_plane_processing THEN 
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IF max_bit > bit j>lane_processing THEN 
Output data bit 

ENDIF 

ENDIF 

3. Filtering Rules for LIR filter 
IF flag is set to pixel 

IF maxjnax_bit = bitjplane_processing THEN 

IF maxbit = bit_plane_processing THEN 

Output one and sign bit 
ELSE 

Output zero 
ENDIF 

ENDIF 

ELSE 

IF max_max_bit >= bit_plane_processing THEN 
IF maxjrit = bit j)lane_processing THEN 
Output one 

ELSE IF max_bit < bit_plane ^processing THEN 

Output zero 
ENDIF 

ENDIF 
ENDIF * 
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The LIC, LIR, and LSC filters of the bit plane encoders 810-0 to 810-15 output 
the output bits to the respective LIC, LIR, LSC storage elements 826-0 to 826-15, 828-0 
to 828-15, and £30-0 to 830-15. 

These output bits are subsequently fed to the bit plane combiners 816-0 to 816- 

15. 

The bit plane combiners 816-0 to 816-15 concatenate these output bits in format 
order LIR LIR LSC which are then stored in the bit plane code buffers 832-0 to 832-15. 
The block code combiner 818 then concatenates the coded output in the block code 
buffers commencing with buffer 832-0 and finishing with buffer 832-15. Thus resulting in 
the coded output bit stream LIR LIC LIR LSC... Afterwards the combiner 818 adds a 
special block termination code. It is in this way, that the encoder 800 is able to encode the 
32x32 block of coefficients in parallel. Each of the bitstreams 810-n to 832-n operate 
simultaneously in parallel thus speeding up the computational process. As can be seen the 
nth bitstream 810-n to 832-n outputs a coded output bitstream equivalent to the output of 
the nth iteration of the preferred method. 

The foregoing only describes a small number of embodiments of the present 
invention, however, modifications and/or changes can be made thereto by a person skilled 
in the art without departing from the scope and spirit of the invention. The present 
embodiments are, therefore, to be considered in all respects to be illustrative and not 
restrictive. 

In the context of this specification, the word "comprising" means "including 
principally but not necessarily solely" or "having" or "including" and not "consisting only 
of. Variations of the word comprising, such as "comprise" and "comprises" have 
corresponding meanings. 
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The claims defining the invention are as follows: 



• « 



1 . A method of coding a block of coefficients, the method comprises the step of: 

(i) performing, for each bitplane of said block of transform coefficients from a 
5 maximum bitplane to a minimum bitplane, the sub-steps of: 

(i)(a) di viding a current bitplane of the block of transform coefficients into a 
number of first areas and/or a number of second areas, wherein each first area comprises a 
number of said coefficients having corresponding most significant bits in the current 
bitplane or less and each second area comprises a number of coefficients having 
10 corresponding most significant bits in a bitplane greater than the current bitplane; 

(i)(b) coding the significance of each said first area in said current bitplane of 
said block of transform coefficients; and 

(i)(c) coding a corresponding bit of each coefficient in each said second area of 
said current bitplane. 

15 

2. A method as claimed in claim 1 > wherein said sub-step (i)(b) comprises the sub- 
steps of: 

(i)(b)(A) coding the significance of each coefficient in any one of said first areas 
in said current bitplane of said block of transform coefficients, where said first area is of a 
20 predetermined minimum size; and 

(i)(b)(B) coding the significance of any one of said first areas in said current 
bitplane of said block of transform coefficients, where said first area is greater than said 
predetermined minimum size. 



25 3. A method as claimed in claim 2, wherein said predetermined minimum size of 
said first area is a 1x1 block consisting of one coefficient. 
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4. A method as claimed in claim 2, wherein said predetermined minimum size of 
said first area is a 2x2 block of four coefficients. 

5. A method of coding a block of transform coefficients, the method comprising the 
step of: 

(i) performing, for each bitplane of said block of transform coefficients from a 
maximum bitplane to a minimum bitplane, the sub-steps of: 

(i)(a) coding the significance of each coefficient in any one or more 
sub-regions of said current bitplane, if said sub-region is of a predetermined minimum 
size and comprise coefficients having corresponding most significant bits in the current 
bitplane or less; 

(i)(b) coding the significance of a said sub-region of a current bitplane 
of said block of transform coefficients, if said sub-region comprises a number of said 
coefficients having corresponding most significiant bits in the current bitplane or less; 

(i)(c) partitioning one said sub-region into further sub-regions if said 
sub-region prior to partitioning is significant and is greater than said predetermined 
minimum size; 

(i)(d) repeating said steps (i)(b) and (i)(c) for each remaining said sub- 
region; and 

(i)(e) coding a corresponding bit of each coefficient in any one or more 
sub-regions of said current bitplane, if the sub-regions comprise coefficients having 
corresponding most significant bits in a bitplane greater than the current bitplane. 

6. A method as claimed in claim 5, wherein said predetermined minimum size is a 
1 x 1 sub-region consisting of one coefficient. 

7. A method as claimed in claim 5, wherein said predetermined minimum size is a 
2x2 sub-region of four coefficients. 
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8. A method as claimed in claim 5, wherein said method prior to said step (i) 
comprises the step of: 

(A) determining said maximum bitplane of said block, wherein the most significant 
bit of each said coefficient of said block is in the maximum bitplane or less. 

9. A method as claimed in claim 6 or 7, wherein said method prior to said step (i) 
comprises the steps of: 

(B) creating a list of insignificant coefficients for storing said sub-regions of 
said predetermined minimum size having coefficients having corresponding most 
significant bits in the current bitplane or less; 

(C) creating a list of insignificant regions for storing said sub-regions 
comprising a number of said coefficients having corresponding most significant bits in 
the current bitplane or less; and 

(D) creating a list of significant coefficients for storing said sub-regions 
comprising coefficients having corresponding most significant bits in a bitplane greater 
than the current bitplane. 

10. A method as claimed in claim 9, wherein said method prior to step (i) further 
comprises the steps of 

(E) initialising said list of insignificant coefficients to empty; 

(F) initialising said list of insignificant regions to include a predetermined 
number of sub-regions; 

(G) initialising said list of significant coefficients to empty. 

11. A method as claimed in claim 1 0, wherein said sub-step (i)(b) further comprise 
the sub-steps of: 
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(0(b)(1) removing said sub-region from the list of insignificant regions if said 
said sub-region is insignificant and is of a said predetermined minimum size; and 

(0(b)(2) adding each one of the coefficients of the removed sub-region to the 
list of insignificant coefficients. 

12. A method as claimed in claim 1 0, wherein said sub-step (i)(b) further comprise 
the sub-steps of: 

(i)(b)(l) removing said sub-region from the list of insignificant regions if said 
said sub-region is significant and is of a said predetermined minimum size; and 

(0(b)(2) adding each one of the coefficients of the removed sub-region to the 
list of significant coefficients. 

13. A method as claimed in claim 10, wherein said sub-step (i)(c) comprises the sub- 
steps of: 

(i)(c)(l) partitioning said sub-region into further sub-regions if said sub-region 
prior to partitioning is significant and is of a size greater than said predetermined 
minimum size; 

(i)(c)(2) removing said sub-region which was partitioned from the list of 
insignificant regions; and 

(0(c)(3) adding the partitioned sub-regions to the list of insignificant regions. 

14. A method as claimed in claim 10, wherein said sub-step (i)(a) further comprise 
the sub-steps of: 

(0(a)(1) removing said coefficient from the list of insignificant coefficients if 
said coefficient is significant; and 

(0(a)(2) adding said removed coefficient to the list of significant coefficients. 
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15. A method as claimed in claim 5, wherein said partitioning step is a quadtree 
partitioning step. 

1 6. Apparatus for coding a block of coefficients, the apparatus comprising: 

means for performing, for each bitplane of said block of transform coefficients 
from a maximum bitplane to a minimum bitplane, the operations of the following division 
means, first coding means, and second coding means; 

division means for dividing a current bitplane of the block of transform 
coefficients into a number of first areas and/or a number of second areas, wherein each 
first area comprises a number of said coefficients having corresponding most significant 
bits in the current bitplane or less and each second area comprises a number of 
coefficients having corresponding most significant bits in a bitplane greater than the 
current bitplane; 

first coding means for coding the significance of each said first area in said 
current bitplane of said block of transform coefficients; and 

second coding means for coding a corresponding bit of each coefficient in each 
said second area of said current bitplane. 

1 7. Apparatus as claimed in claim 1 6, wherein said first coding means comprises: 
means for coding the significance of each coefficient in any one of said first 

areas in said current bitplane of said block of transform coefficients, where said first area 
is of a predetermined minimum size; and 

means for coding the significance of any one of said first areas in said current 
bitplane of said block of transform coefficients, where said first area is greater than said 
predetermined minimum size. 

1 8. Apparatus as claimed in claim 17 V wherein said predetermined minimum size of 
said first area is a 1 xl block consisting of one coefficient. 
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1 9. Apparatus as claimed in claim 1 7, wherein said predetermined minimum size of 
said first area is a 2x2 block of four coefficients. 

20. Apparatus for coding a block of transform coefficients, the apparatus comprising: 

means for performing, for each bitplane of said block of transform coefficients 
from a maximum bitplane to a minimum bitplane, the operations of the following first 
coding means, second coding means, partitioning means, repetition means, and third 
coding means; 

first coding means for coding the significance of each coefficient in any one or 
more sub-regions of said current bitplane, if said sub-region is of a predetermined 
minimum size and comprise coefficients having corresponding most significant bits in the 
current bitplane or less; 

second coding means for coding the significance of a said sub-region of a current 
bitplane of said block of transform coefficients, if said sub-region comprises a number of 
said coefficients having corresponding most significant bits in the current bitplane or 
less; 

partition means for partitioning one said sub-region into further sub-regions if 
said sub-region prior to partitioning is significant and is greater than said predetermined 
minimum size; 

repetition means for repeating the operations of the second coding means and 
partition means for each remaining said sub-region; and 

third coding means for coding a corresponding bit of each coefficient in any one 
or more sub-regions of said current bitplane, if the sub-regions comprise coefficients 
having corresponding most significant bits in a bitplane greater than the current bitplane. 

2 1 . Apparatus as claimed in claim 20, wherein said predetermined minimum size is 
a 1x1 sub-region consisting of one coefficient. 



CFP1487AU IPR27 477040 



.l:\ELEC\CISRA\IPR\IPR27\477040.doc 



-33 - 

22. Apparatus as claimed in claim 20, wherein said predetermined minimum size is a 
2x2 sub-region of four coefficients. 

23. Apparatus as claimed in claim 20, wherein said apparatus further comprises: 

means for determining said maximum bitplane of said block, wherein the most 
significant bit of each said coefficient of said block is in the maximum bitplane or less. 

24. Apparatus as claimed in claim 21 or 22, wherein said apparatus further 
comprises: 

means for creating a list of insignificant coefficients for storing said sub- 
regions of said predetermined minimum size having coefficients having corresponding 
most significant bits in the current bitplane or less; 

means for creating a list of insignificant regions for storing said sub-regions 
comprising a number of said coefficients having corresponding most significiant bits in 
the current bitplane or less; and 

means for creating a list of significant coefficients for storing said sub-regions 
comprising coefficients having corresponding most significant bits in a bitplane greater 
than the current bitplane. 

25. Apparatus as claimed in claim 24, wherein said apparatus further comprises: 
means for initialising said list of insignificant coefficients to empty; 

means for initialising said list of insignificant regions to include a 
predetermined number of sub-regions; 

means for initialising said list of significant coefficients to empty. 

26. Apparatus as claimed in claim 25, wherein said apparatus further comprises: 
means for removing said sub-region from the list of insignificant regions if said 

said sub-region is insignificant and is of a said predetermined minimum size; and 
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means for adding each one of the coefficients of the removed sub-region to the 
list of insignificant coefficients. 

27. Apparatus as claimed in claim 25, wherein said apparatus further comprises: 
5 means for removing said sub-region from the list of insignificant regions if said 

said sub-region is significant and is of a said predetermined minimum size; and 

means for adding each one of the coefficients of the removed sub-region to the 
list of significant coefficients. 

10 28. Apparatus as claimed in claim 25, wherein said apparatus comprises: 

partition means for partitioning said sub-region into further sub-regions if said 
sub-region prior to partitioning is significant and is of a size greater than said 
predetermined minimum size; 

means for removing said sub-region which was partitioned from the list of 
15 insignificant regions; and 

means for adding the partitioned sub-regions to the list of insignificant regions. 

29. Apparatus as claimed in claim 25, wherein said apparatus comprises: 

means for removing said coefficient from the list of insignificant coefficients if 
20 said coefficient is significant; and 

means for adding said removed coefficient to the list of significant coefficients. 

30. Apparatus as claimed in claim 20, wherein said partition means comprises a 
quadtree partitioning means. 

25 
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31. A computer program product comprising a computer readable medium having a 
computer program for coding a block of coefficients, the computer program product 
comprising: 

means for performing, for each bitplane of said block of transform coefficients 
from a maximum bitplane to a minimum bitplane, the operations of the following 
arrangement means, first coding means, and second coding means; 

division means for dividing a current bitplane of the block of transform 
coefficients into a number of first areas and/or a number of second areas, wherein each 
first area comprises a number of said coefficients having corresponding most significant 
bits in the current bitplane or less and each second area comprises a number of 
coefficients having corresponding most significant bits in a bitplane greater than the 
current bitplane; 

first coding means for coding the significance of each said first area in said 
current bitplane of said block of transform coefficients; and 

second coding means for coding a corresponding bit of each coefficient in each 
said second area of said current bitplane. 

32. A computer program product comprising a computer readable medium having a 
computer program for coding a block of transform coefficients, the computer program 
product comprising: 

means for performing, for each bitplane of said block of transform coefficients 
from a maximum bitplane to a minimum bitplane, the operations of the following first 
coding means, second coding means, partitioning means, repetition means, and third 
coding means; 

first coding means for coding the significance of each coefficient in any one or 
more sub-regions of said current bitplane, if said sub-region is of a predetermined 
minimum size and comprise coefficients having corresponding most significant bits in the 
current bitplane or less; 
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second coding means for coding the significance of a said sub-region of a current 
bitplane of said block of transform coefficients, if said sub-region comprises a number of 
said coefficients having corresponding most significiant bits in the current bitplane or 

less; 

partition means for partitioning one said sub-region into further sub-regions if 
said sub-region prior to partitioning is significant and is greater than said predetermined 
minimum size; 

repetition means for repeating the operations of the second coding means and 
partition means for each remaining said sub-region; and 

third coding means for coding a corresponding bit of each coefficient in any one 
or more sub-regions of said current bitplane, if the sub-regions comprise coefficients 
having corresponding most significant bits in a bitplane greater than the current bitplane. 

33. An encoder for generating a coded representation of a digital image, said encoder 
comprising: 

an input means for inputting a block of coefficients of said digital image; 

a plurality of tree builders, wherein each tree builder generates a tree and nodes 
based on a corresponding bitplane of said block of coefficients, and each said node 
corresponds to one of a plurality of sub-regions of said block of coefficients or to one of 
said coefficients and each said node having a data value indicative of the significance of 
said one sub-region or said one coefficent for that bitplane; 

a bitplane converter for generating respective bitplanes from the block of 
coefficients; and 

a bitplane encoder coupled to said plurality of tree builders and said bitplane 
converter for producing a coded representation of the digital image from said trees and 
bitplanes, wherein said bitplane encoder codes the significance of said sub-regions or 
coefficients in a current said bitplane when said sub-regions and coefficients have > 
corresponding most significant bits in the current bitplane or less and codes corresponding 
bits of coefficients in said current bitplane when said coefficients have corresponding 
most significant bits in a bitplane greater than the current bitplane. 
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34. An encoder as claimed in claim 33, wherein said encoder further comprises: 

first storage means, coupled to said bitplane encoder, for temporarily storing a list of 
insignificant coefficients. 

35. An encoder as claimed in claim 33 or 34, wherein said encoder further 
comprises: second storage means, coupled to said bitplane encoder for temporarily storing 
a list of signficiant coefficents. 

36. An encoder as claimed in claim 33, wherein said encoder further comprises: third 
storage means, coupled to said bitplane encoder for temporarily storing a first list of 
insignificant regions. 

37. An encoder as claimed in claim 33, wherein said encoder further comprises: 
fourth storage means, coupled to said bitplane encoder for temporarily storing a second 
list of insignificant regions. 

38. An encoder for generating a coded representation of a digital image, said encoder 
comprising: 

an input means for inputting a block of coefficients of said digital image; 

a tree builder for generating a tree and nodes based on said block, wherein each 
said node corresponds to one of a plurality of regions of said coefficients or to one of said 
coefficients and each said node having a bitplane number of the largest significiant 
bitplane of the region or coefficient corresponding to that node; 

a tree sorter for sorting said nodes in a predetermined order; 

a plurality of bitplane encoders coupled to said tree sorter; wherein said nth 
bitplane encoder outputs a coded representation of nth bitplane of the coefficients and 
wherein said nth bitplane encoder codes the significance of said sub-regions or 
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coefficients of said nth bitplane when said sub-regions and coefficients have 
corresponding most significant bits in the nth bitplane or less and codes corresponding 
bits of coefficients in said nth bitplane when said coefficients have corresponding most 
significant bits in a bitplane greater than the nth bitplane; and 

5 a combiner for combining the coded representations of the n bitplanes to produce 

a coded representation of the digital image. 

39. An encoder as claimed in claim 38, wherein said encoder further comprises: 

first storage means, coupled between said tree sorter and said n bitplane encoders, for 
10 storing a list of insignificant regions and coefficients. 



15 



40. An encoder as claimed in claim 38 or 39, wherein said encoder further 
comprises: second storage means, coupled to said tree sorter and said n bitplane encoders, 
for storing a list of signficiant coefficents in sublists according to the significant bit 
number of the significant coefficent. 



41. A method of encoding a digital image, the method comprising the preferred 
embodiment of the method as substantially described herein. 



• • • 



20 42. Apparatus for encoding a digital image, the apparatus comprising the First , 

Second, or Third preferred embodiment of the apparatus substantially as described herein. 



43. A computer program product for encoding a digital image, the product 
comprising a computer readable medium having a computer program for implementing 
25 the method of claim 41. 

Dated 28 October, 1999 
Canon Kabushiki Kaisha 

Patent Attorneys for the Applicant/Nominated Person 
SPRUSON & FERGUSON 



CFP1487AU IPR27 477040 



.t:\ElEC\CISRA\lPR\tPR27\477040.doc 



1/6 





r 


LLl 


HL1 




3 








r 


LH1 


HH1 




5 






Fig. 1A 




Fig 


. 1B 



8n 9- 



10 



LL2 


HL2 


HL1 

---11 


LH2 


HH2 


LH1 


HH1 



Fig. 2 



LL4 



Fig. 3 



CFPunknAU IPR27 477040 



fl:VELECVCISRA\IPR\IPR27| 477040 



2/6 




Fig. 4 Tiling of the subbands 
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